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We present in this paper two definitions of short-term frequency stability: 
(i) time domain, the expected value of the variance of the fractional 
frequency fluctuations from nominal frequency, (al(N, T, t)), in which 
N is the number of samples, T is the averaging time plus the dead time 
between samples, and t is the averaging time; and (ii) frequency domain, 
the power spectral density of the fractional frequency departure from 
nominal frequency, £„(/). We discuss the topics of conversion from the fre- 
quency domain to the time domain and conversion among time domain 
measures. 

All measurements were made in the time domain, using period counting 
techniques. An oscillator was offset in frequency by using a specially 
built quartz crystal unit plated for 10 kHz beloiv the frequency of the other 
sources. This oscillator was used to obtain the beat frequency required by 
the period counting approach. 

Since the use of {p\(2, T, r)) as a measure of short-term stability has 
significant advantages over (<rl(N, T, t)>, the relationship between the 
two quantities was investigated. For averaging times of one second or less, 
(cr 2 v (2, T, t)> and (<rl(N, T, t)) were almost equal. 

The short-term stability of several quartz crystal oscillators and precision 
frequency generators ivas measured. The stability over the shorter averaging 
times was nearly equal for most of the oscillators. At longer times, the 
stability of each oscillator was unique. The frequency generators demon- 
strated similar stability over averaging times of 10 and 100 milliseconds, 
but were unique elsewhere. The accuracy of all measurements was limited 
by systematic effects from the environment and the measurement equipment 
itself. 
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I. INTRODUCTION 

When the phrase "short-term frequency stability" is mentioned, one 
can immediately infer that frequency varies with time and that a short 
time interval is involved. Many questions are, at this point, un- 
answered: How short is the interval? How is stability defined? What 
system malfunctions can result from excessive instability? What 
definitions are appropriate for the specific application and why? 

Some answers to these questions are developed here ; others must be 
determined by the user in terms of the specific system involved. If 
a measurement of short-term frequency stability is to be of significant 
use, each of these questions must be resolved. 

Although ever-increasing interest in short-term stability has existed 
for 25 or 30 years, no universally accepted definition of short-term 
stability exists. Primarily, early research in this area was extremely 
application-oriented. Little general work was performed with the 
result that many definitions were developed. Individuals and organiza- 
tions defined and used stability in terms of their own applications. 
The resultant confusion showed that a more general definition appli- 
cable to the majority of cases was desirable in the topic of short-term 
frequency stability. 

Today, many users talk about stable oscillators without understand- 
ing why or even if such precision is necessary. Manufacturers add to 
the present confusion through lack of rigor in their performance speci- 
fications. That is, they often merely quote a number without defining 
what, how, or why they are measuring the stability of their equipment. 

Sophisticated systems exist today which require more precision than 
frequency standards of 10 to 15 years ago. Only recently has the pre- 
cision oscillator been liberated from its position in secluded portions of 
carefully controlled laboratories. 1 Spacecraft applications suffice as 
good examples of the strides made in this area; wide temperature 
variations, severe mechanical vibrations, and varying oscillator voltage 
are often encountered. In the immediate future, these requirements 
will tighten even further. A proposed collision avoidance system for 
aircraft will require stable oscillators. With higher and higher data 
rates in communication systems, even the dependable telephone office 
will contain precision oscillators. As precision oscillators come into 
general use, accepted measurement theory and techniques are abso- 
lutely necessary. 

In view of the above, two definitions of frequency stability are pre- 
sented in this paper. One definition is in the time domain; the other 
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is in the frequency domain. Conversion between the domains, an ex- 
tremely important subject, is also treated. Every attempt has been 
made to be consistent with the IEEE Subcommittee on Frequency 
Stability.* It is anticipated that the subcommittee will publish its 
formal definition sometime in 1971. 

II. GENERAL DISCUSSION 

2.1 General Definitions 

The general definition of instantaneous angular frequency is the 
time-rate of change of phase. That is 

«« - § - ♦■ (1) 

An oscillator output signal may be described as 

g(t) = [A + e(t)] cos [at + 0(0] , (2a) 

g (t) = [A + e(0] cos [2irFt + 0(0], ( 2b ) 

where 

u = nominal angular frequency of the oscillator, 

F = (d/2ir = nominal frequency in hertz of the oscillator, 

A = nominal amplitude of the oscillator, 

e(i) = small, slowly time-varying amplitude fluctuations, and 

0(0 = slowly time-varying real function (phase). 

Here, g{t) may be considered as either a voltage or a current. If the 

oscillator is to qualify as a precision oscillator, it is required that 



e(t) 



A 

0(0 



2ttF 



« 1, (3) 

« 1. (4) 



2.2 Statistical Processes 

For the present, assume that the variables of equation (2) are ran- 
dom processes. It is generally assumed in the study of frequency stabil- 
ity that amplitude deviations, e(t), do not directly affect frequency or 

♦This subcommittee, formed in 1964 as a result of the IEEE-NASA Sympo- 
sium on short-term frequency stability, is formally named the Subcommittee on 
Frequency Stability of the Technical Committee on Frequency and Time of the 
Group on Instrumentation and Measurement of the IEEE. 
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phase. 2 It must be stressed that tf>(t) presumably contains all fre- 
quency and phase fluctuations and is the main quantity considered. 

If a random process is stationary in the strict sense, it is unaffected 
by translations of the origin for time. 3 This implies that the probabil- 
ity distribution of values in the ensemble will be the same at any two 
instants. Hence, examination of the ensemble yields no data as to 
which instant of time the examination occurred. 

Texts on random noise and stochastic processes assume that most 
noise functions may be represented or approximated as stationary 
gaussian random processes with zero averages. 4 The justification for 
assuming a gaussian distribution lies in the central limit theorem. This 
well-known theorem states that the distribution of the sum of a large 
number of independent random variables will approach a gaussian dis- 
tribution. S. 0. Rice showed that noise does, in general, conform to a 
gaussian distribution, provided that a sufficiently large sample is 
taken. 5 Zero averages of each random variable are assumed for con- 
venience. 

A process can be defined as ergodic when the statistics of one sys- 
tem over an infinite period of time are equivalent to the statistics of 
an infinite ensemble of systems at any given instant. (Note that sta- 
tionarity is a necessary but not sufficient condition for ergodicity.) 
Since the processes are stationary and gaussian, the noise functions 
considered in this paper are assumed ergodic. 

In the real world, no process can be stationary in the strict sense. To 
be stationary, the probability distributions across the ensemble must 
be the same for any selected instant of time. This stipulation includes 
time as it approaches infinity. If the process is terminated at some 
future time, the concept of stationarity in the strict sense is violated. 
The random process, X t , is called stationary in the wide sense, if the 
first and second order moments of its random variables exist and 
satisfy 

E{X t ) = constant, 

a 2 (X t ) = constant, 

E{[X I+T - E(X t+T ))[X t - E(X t )]} = R(r), 
where 

R(t) = autocorrelation function, and 

t = some arbitrary finite time interval. 

The actual verification of stationarity is not feasible. The main re- 
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quirement is that the physical process be consistent with the concept 
of stationarity. That is, if measurements are to be of any use, they 
must reasonably describe the process at all times in the future, prior 
to termination of the process. 

2.3 Systematics 

When a study is made of a precision oscillator or frequency genera- 
tor, great pains are often taken to isolate the circuits from electrical 
disturbances. This is done to minimize the systematic effects so that 
only the truly random noise can be observed. For evaluation of the 
generator itself, this is a sound practice. However, in the real world, 
electrical disturbances do exist. For example, in a data processing 
system there are card readers, magnetic tape transports, and other 
devices. Each of these devices has numerous electro-mechanical relays 
which are continually chattering. Thus, it is desirable to insure that 
a frequency generator has the necessary stability. This obviously 
means it must demonstrate adequate stability in the operating en- 
vironment with the contribution of the systematic effects. 

In equation (2), it was assumed that the main contribution of <f>(t) 
came from the oscillator. Now it is necessary to loosen this assumption 
to include the contributions to <f>(t) from the operating environment. 
While these added uncertainties are not caused by the oscillator, any 
attempt to observe <f>(t) will include these effects. Therefore, <f>(t) in 
equation (2) can be considered to include 



<f>(t) m c(t) + s(f) + n(t), (5) 



where 



c(t) = phase due to aging (drift), 

s(t) = phase due to environmental systematic effects, and 

n(t) = phase due to oscillator random noise. 

The contributions of c(t) are strictly long term, affecting time inter- 
vals of a thousand seconds or longer. Hence, for time periods of less 
than a thousand seconds, c(t) becomes almost constant and thus is not 
significant. The exact composition of s(t) is unknown, although it has 
both long- and short-term effects. Again, the long-term component of 
the systematic effects becomes insignificant for short time periods. 
For these short intervals, <f>(t) becomes 

*(0 = «.(0 + n(t), (6) 
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where 

s n (t) = short-term components of the systematic effects. 

For the present, it will be assumed that the short-term component 
of the systematic effects is a random process which is stationary at 
least in the wide sense: gaussian, with zero averages, and ergodic. 
This stipulation may later fall as more is learned about the nature of 
systematic effects. Certainly, even if not truly random, the effects will 
appear as short-term instabilities. 

Any environment will contribute a term s(t) to (5) . Obviously, if the 
systematica, s(t), can be minimized to the point where their contribu- 
tion is several orders of magnitude less than the oscillator noise, n(t) 
becomes the only significant measurable. On the other hand, if the 
environment is extremely noise contaminated, the actual oscillator 
instabilities may be "swamped" by the systematic effects. Conditions 
can exist that are so contaminated that coherent operation of many 
electronic systems is not possible. The systematic effects will contribute 
to the short-term instabilities in an additive manner on a power basis. 
If an estimate of the short-term stability of an oscillator or fre- 
quency generator can be obtained in a carefully controlled, low-noise 
environment and if a subsequent estimate can be made in an operating 
atmosphere, the resulting instabilities may be compared. The contri- 
bution of the noise due to the systematic effects of the environment 
may then be described. 

III. DEFINITIONS 

3.1 General 

Many applications exist that necessitate the use of highly stable os- 
cillators or frequency generators. Due to the accuracy requirements of 
these various applications, some measure of oscillator instability is 
imperative. Although many persons view such a quantity merely as a 
vehicle for oscillator selection and comparison between oscillators, 
these uses are only academic. Strictly speaking, a measure of instabil- 
ity enables prediction of oscillator performance or, if not sufficiently 
stable, nonperformance in a given system. More precisely, any devia- 
tion from the intended frequency will degrade the performance of any 
system. Specific cases of the effects of frequency stability on an 
operation are discussed by J. A. Barnes. 6 - 7 

Presented below are definitions of short-term frequency stability 
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both in the time and frequency domains. Translation between the 
domains is also discussed. 

3.2 Time Domain 

In this paper, short-term frequency stability in the time domain is 
denned as the ensemble average of the variance of fractional frequency 
fluctuations from nominal frequency. This definition is based on the 
work of D. W. Allan. 8 

It is convenient to make the following definition 



»«-&■ (7) 



where 



<j)(t) = d4>/dt = u(t) {from equations (1) and (2)}, and 
F l = long-term average frequency, hertz, of the oscillator {from 
equation (2)}. 

Taking the short-term average value of equation (7) 

*~rL A) Srifr ' (8) 

y>~-] tt y(t)dt = ^ , (9) 

where n, k = 1, 2, • • • , m, • • • . 

Using equations (8) and (9) , an expression in terms of the sample 
variance is obtained 

■Stf, T, r) = j^-j t {vn -j}t ft)", (10) 

where 

N = number of samples, 

T = time between the beginning of successive sample intervals, and 

t = sample time. 

Short-term frequency stability in the time domain is defined as the 
expected value or ensemble average of equation (10), the variance of 
fractional frequency fluctuations from nominal frequency. That is 



<< 



^,T,,)) = 4^i:^-^i:^) 2 ], w 
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where E[X] denotes the expected value or ensemble average of X. 
Note that this definition of frequency stability is dimensionless. 

The justification of the use of the term \/{N — 1), located directly 
to the left of the first summation in equations (10) and (11), follows 
from the theory of estimation (see Ref . 9) . Thus, in order to obtain an 
unbiased estimate of the population variance, the sample variance 
is multiplied by N/(N — 1), resulting in equations (10) and (11). 
Clearly, for large samples, the population and sample variances be- 
come very nearly equal. 

A popular expression of short-term stability in the time domain is 
the expected value of the standard deviation (rms value) of the frac- 
tional frequency fluctuations from nominal frequency. Expressed func- 
tionally, this becomes 

MN, t; t)> = ^{[j^T Z [y n - y g ft)*]'}- (12) 

It should be noted that the square root of equation (11), (<rl(N, T, t)), 
is equal to equation (12), (<r 9 (N, T,t)), only when the successive samples 
are truly stationary in the wide sense. If the samples appear only 
slightly nonstationary, approximate equality may be assumed as 

(Mr.r^aMr.r)). (13) 

3.3 Frequency Domain 

L. S. Cutler and C. L. Searle showed that a practical definition of 
short-term frequency stability can be given in terms of autocorrelation 
functions and power spectral densities. 10 

The autocorrelation function of phase is defined as 

R,(t) = lim i f *(* + T )*(0 dt. (14) 

7-_oo 1 J 

R$(t) can also be determined using numerical methods on a digital 
computer if enough samples can be taken, such as 



R*(r) ^Z^IttM (15) 

where N is some large positive integer. 

Let R<p (t) be the autocorrelation function of a process which is sta- 
tionary in the wide sense and continuous. From the Wiener-Khintchine 
theorem, it is known that autocorrelation functions and power spectral 
densities are Fourier transform pairs. Hence, the two-sided spectral 
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density of phase becomes 10 * 

S*(f) = f R,(r)e- i2TfT dr. (16) 

J-aa 

From this, the one-sided spectral density of phase, <S (/), becomes 6 

S„(f) = 2 [ R+(t) cos (2x/t) dr, (17) 

Jo 

R,(r) = 2 f S,(f) cos (2t/t) dj. (18) 

Jo 

In normal Fourier analysis, 4 differentiation in the time domain cor- 
responds to multiplication by j%rj in the frequency domain. In terms 
of power spectral densities, this becomes (2tt/) 2 . Thus 

S^D - (2tt/)%(/). (19) 

But Si(j) is the power spectral density of frequency fluctuations. 
To obtain the power spectral density of instantaneous fractional fre- 
quency departure from nominal frequency, equation (19) must be 
normalized 

s -<» - <0jf - 5 «•»• (2o) 

Thus, S v (/), equation (20), is the definition of short-term frequency 
stability in the frequency domain. Note that S v (j) has the units "per 
hertz." 

3.4 Translations Between Domains 

3.4.1 Frequency Domain to Time Domain 

L. S. Cutler has shown that the following equation allows calculation 
of the time-domain stability from the frequency domain 6 



Wl(N, T, r)> 

.V 
(N 

where 

r = T/t. 



V f a ( « [sin 2 (x/r)] [ _ s in 2 (irrjNr) 1 , , 

=1)A ^ Wr) 2 L 1 N* sin* Mr)]* 1 ' (21) 



* In this paper, the convention is used that the term Fx, as in equations (2) and 
(7), is the cycle frequency, hertz, of the oscillator. The term / is a Fourier fre- 
quency, hertz, and is not a function of time. 
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3.4.2 Translations Among Time-Domain Measures 

In certain applications, translation among time-domain measures 
is of interest. The following method, presented by Barnes," allows 
calculation of (<rl(N 2 , T 2 , t 2 )), given an estimate of (<rl(N, T, r)>, for 
functions which have a power law spectral density. 

Since most precision oscillators and frequency generators have 
power law spectral densities, it is possible to define two bias functions, 
Bi(N, r, n) and B 2 (r, n), as follows 

B l (N,r, lt )^ <<r « (2| T| T)> , (22) 



^-stst. <*> 



where 



ju = spectral type (related to the shape of the spectrum. In Ref. 11, 
Barnes shows how n may be found, given B t ). 

Now an estimate of (a- 2 v (N 2 , T 2 , t 2 )) can be made 

Xt,/ J5i(iVj , r, , M)-oa(Pi » m) / 24 \ 

See Ref. 11 for a listing of the bias functions for various spectral types, 
number of samples, and r. 

IV. MEASUREMENT TECHNIQUES 

4.1 Period Counting Technique 

The basic functional description of this method is shown in Fig. 
1. This arrangement is similar to that presented in Ref. 2. Two similar 
oscillators are offset in frequency. This offset can be produced by 
adjustment of the tuning control on the oscillator or use of a crystal 
which produces a slightly different average frequency. It is assumed 
that these procedures change only the long-term average frequency 
of the oscillators and that the short-term instabilities are not affected. 

As in equation (2) , the output signals from these similar oscillators 
are fed to a mixer or product detector. The resulting output is fed to a 
low pass filter. This yields an expression: 

g (t) at ±£i { cos [MFi -F 2 )t + (*(Q - *,(*))] } . (25) 
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This signal is the nominal frequency difference between the sources 
plus the instabilities of each. (For a more detailed discussion, see Refs. 
8, 10 or 12.) Define 

F = Ft — F 2 , 

*(0 = [0i(O - *i(0]. 
Substituting these values into equation (25) 



fc(0S^ cos [2rF t +*(0]. 



(26) 



This quantity is fed directly to a digital counter. 

The theoretical time, t , between the first and Afth positive-going 
zero crossings, if the signals were ideal, is 



To = 



M 

F 



The actual elapsed time, t, between the first and Afth zero crossing is 

(27) 

rr o 
The uncertainties are characterized as 

jKjo + r) - $(<„) 



T = ^" 



M r* fa + r) - *&)] 

2ttF 



3t = 



2wF 



Therefore, equation (27) becomes 

t = ro - St. (28) 

Because of equation (4) , St is small. Cutler and Searle show that if 
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Fig. 1 — Fundamental description, period counting technique. 
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variations of St are small, the following may be assumed 

*(<o + r) ^ *(*o + r ), (29) 



substituting 



^7rr 



Substituting equation (30) into equations (8) and (9) gives 



Fo_ |>(l ; - r,) - $(/,,) | /:, 



y - = ^ L 2^ J = YJo 5t " • (31) 



(32) 



. _ f r *(t 0k + to) - $(<o t ) i _ _^_ 

For each sampling sequence, iV estimates of #„ and y k are computed. 
Substituting these values into equation (11) 

(4(N, T, r)) - ^^ ± (fa Sr. - l± fa Sr.J] , (33) 

W, T, r)> = *[( 8r ^ T ) gj E (*. - i E •*)"] • (34) 

4.2 A Special Case 

When JV = 2, equation (11) is simplified 

«<?, t, r)> = # [i; (&. - i g &)'] ■ (35) 

Likewise, as in equation (34), 

<^(2, T, t)> = jr[^jj g (Sr n - It 5r.) 2 ] ■ 
Recall that t = t — 8t 

«(2, T, r)> = E\jk g {(to " r„) - | g (r - r 4 )}'] ■ 
Expanding the right side of this equation and reducing 

(al(2, T, r)> = E^k (T2 = Tl)2 ] ■ (38) 

Let T2 — Ti = Ato 

(*1(2,T,t)) = e[^]]. (39) 



(36) 



(37) 
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The following term often appears in the literature on frequency 
stability 13 

f = f. m 

where 

AF = frequency difference between received and local standards 
(hertz) , 

F = nominal frequency, 
At = accumulated time error corresponding to change in phase, and 

T = averaging time. 

The expression in equation (40) is frequently used in calculating the 
long-term stability or drift rate of an oscillator. The application of 
equation (40) has been well documented in many sources. The differ- 
ence between two readings of equation (40) is recognized as the defini- 
tion of long-term stability, yielding a peak-to-peak value of frequency 
drift over a specified time period. 

As the time interval is compressed, the oscillator instabilities dem- 
onstrate more randomness while being less subject to drift. In the 
limit, equation (40) yields an instantaneous peak-to-peak value of the 
fractional frequency fluctuations from nominal frequency. Letting 
t = t and substituting equation (40) into equation (39), 

«(2,T,r))=^[^(^) 8 ], (41a) 

(al(2, T, r)> - E\± (AF ) 2 ] , (41b) 

(a 2 u (2, T, t)) = E)±, (F Q2 - F 01 ) 2 J , (41c) 

where 

F i , F Q2 = two successive samples of the beat frequency, F , over 
an averaging time, t. 

In a similar manner, the standard deviation becomes 

M2, T, r)> = E {^ff i [<*■ - ^oOT 2 }- (42) 

In Section 3.4.2, it was shown that, given the spectral type, /*, 
translations between time domain measures can be made. Recalling 
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equation (22) 

p (N r ,a _ M<N, T, r)) 

It is obvious that if 

(al(N,T,T)) = (<tI(2,T,t)), (43) 

then 

B^N, r, M ) = 1. (44) 

Barnes showed that for r > 1, equation (44) holds in two cases, when 
ix = -1.00 and -2.00. 11 For r = 1, equation (44) holds for il = -1.00 
only. Allan showed that when the spectral type, jx, is equal to minus 
one, white noise frequency modulation is present. 8 When \x equals 
minus two, flicker noise phase modulation is indicated. 

As shown by E. A. Gerber and R. A. Sykes, 14 and Cutler and 
Searle, 10 there are three main sources of noise in oscillators. These 
are: 

(i) additive noise (added to signal) , 
(w) thermal and shot noise (perturbs oscillation) , and 
(Hi) flicker (1//) noise frequency modulation. (See Ref. 15 for a 
discussion of flicker noise.) 

For very short time intervals, the additive (white) noise predomi- 
nates. For longer intervals, flicker noise frequency modulation pre- 
vails. 18 Thermal and shot noise are overpowered by the other two 
types. 10 

For oscillators, /* normally assumes two values 

M^O, 

M = -1. 

When the latter is true, B^N, r, M ) = 1 and (^(N, T, t)) ^ <^(2, T, r)>. 
When fi ~ 0, however, this does not hold. 

There are many indications that the most basic parameter of fre- 
quency stability in the time domain is (o£ (2, t, t) ) (no dead time between 
samples). Initially, there is no guarantee that (<r£(«> , T, t)) will converge. 
Secondly, even if it were possible to assume convergence, it is not 
practical to take enough samples at the longer intervals to assure 
meaningful results. Next, it can be shown 8 that (crl(2, t, t,)) converges 
even for divergent (<rl(N, T, t)). Therefore, the greatest significance 
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of (tr^(2, r, t)) as a measure of short-term frequency stability is that 
it eliminates the embarrassing divergence of flicker noise contributions 
asJV-> oo m(&t(N,T,T)). 

In addition, some noise functions have extremely long periods, 
even beyond one cycle per year. These low frequency components 
affect estimates of (<rl(N, T, t)) even though their periods are too long 
to have any influence on an actual system. As a result, (<r*(2, r, t)) 
is more constant in time than (<rl(N, T, t)). 

In physical applications, (a* (2, t, t)> is often more directly applicable 
than other expressions. For example, in radar it can be shown 8 that 
the expression for calculating doppler range errors is directly propor- 
tional to (<rl(2, t, t)). In timing, the mean-square second difference 
of phase is often useful. 7,15 It can be shown 6 that (cr*(2, r, t)) is directly 
proportional to the mean-square second difference of phase. 

In a practical sense, measurement of (<r*(2, T, t)) is easier to achieve 
than (cl(N, T, t)>. Storage requirements for the latter become excessive 
as N becomes large. Usually, the most practical method of making 
estimates of (<rl(N, T, t)) is the use of a magnetic tape unit for storage 
of data. The data may then be processed off-line on a special purpose 
or commercial computer. 

For ((rl(2, T, t)>, storage requirements are small. Neglecting processing 
requirements, only one summation register is necessary to obtain the 
ensemble average. Resulting equipment is small and portable. Com- 
putations can be made on-line, in real time. Using this approach, 
reliable measurements of short-term stability in the time domain are 
practical at field locations. 

V. MEASUREMENTS 

5.1 General 

Of prime interest to this paper is the measurement of the short- 
term frequency stability of a frequency and time of year generator 
to be used in a large, special purpose computer. This generator con- 
sists of a rack of equipment which produces a total of 17 different 
square wave signals ranging from 9.5367 Hz to 20 MHz. These sig- 
nals are used as clock frequencies for the computer. 

The primary frequency source consists of three 5-MHz quartz 
crystal oscillators. 1 Two of these oscillators, designated as slave and 
standby, are phase locked to the other oscillator, called the master. 
The outputs of the master-slave pair are combined in three digital 
mixers and fed to three counter chains. Each counter chain output 
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is compared to the corresponding outputs of the other two counters. 
The two signals that very nearly coincide are combined and fed to 
external users via cables. The output from the standby oscillator is 
not used. The standby oscillator is present only because of the five day 
initial warm-up period. It is phase locked to the master oscillator to 
speed switching into the system should a failure of one of the other 
two oscillators occur. 

The time of year generator simply uses a 1-MHz combined output 
and generates a 42-bit BCD parallel time of year code. 

A VLF receiver is used to check the 5-MHz oscillators against pre- 
cision VLF stations. Daily frequency checks reduce the actual 
frequency error. The specified long-term stability of each oscillator 
is 1 pp 10 10 per day. [This is a measure of &F/F as shown in equation 
(40). The expression 1 pp 10 10 is a commonly used abbreviation for 
1 X 10 -10 .] Thus, in theory at least, long-term error (drift) never ex- 
ceeds that which can be accumulated in a single day. 

Provisions have been made to indicate to operating personnel if 
errors have occurred. These include sensors to detect missing pulses, 
the loss of an output, counter synchronization errors, or a phase lock 
circuit approaching its limits. These techniques are present merely to 
add additional reliability to the system. 

The phase-lock circuit permits two oscillators to be phase locked 
over a frequency change of ±1 pp 10 8 with a maximum phase error 
between the two oscillators of less than ±60 milliradians. The circuit 
can "capture" over a range of ±2.5 pp 10 8 with a phase error of ±160 
milliradians. 

Whether instabilities are caused directly by an oscillator or by 
associated circuitry, various problems can result from excessive insta- 
bilities. These include (i) loss of phase lock, (n) loss of counter chain 
synchronization resulting in one or more false outputs, {Hi) degrada- 
tion of stability delivered to users, and (iv) failure of the frequency 
generator. Loss of phase lock will occur when linear drift or phase 
errors caused by excessive instability of an oscillator exceed the above- 
given limits. When phase lock is lost, short-term stability is degraded 
even further. When a counter chain loses synchronization, the resulting 
false outputs could have serious consequences to the data processing 
system. 

Once the stability is degraded to some critical level, the data 
processing system will begin to lose accuracy and resolution; time-of- 
year errors will accumulate. Pulses propagating through delay lines 
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will not coincide with intended clock pulses. Loss of data and parity 
errors will result. When the parity count is sufficiently large, a soft- 
ware program will attempt to regain coherence of the data processing 
system, which will cause destruction of data. Since the generator is the 
system clock, failure of the generator will cause failure of the system. 
Possibly the most serious problems occur when the stability is mar- 
ginal, causing the system to respond with false data, without any 
indication to operating personnel. 

Since the generator is located in the operating environment, all 
electrical disturbances caused by peripheral equipment add to the 
instabilities (see Section 2.3). The signals are distributed to users via 
cables. Each cable, up to 300 feet in length, acts as an "antenna" to 
the systematic noise, resulting in greater degradation of stability. 

It was desirable to determine the short-term frequency stability in 
several configurations: 

(i) Oscillator output in a "quiet" environment (sinusoid). 
(ii) Output at terminals of generator in a "quiet" environment 

(square wave). 
(Hi) Oscillator output in an operating environment (sinusoid). 
(iv) Output at terminals of generator in an operating environment 

(square wave). 
(v) Generator output at end of a 200-foot cable in an operating 

environment (square wave). 
(vi) Generator output at end of a 200-foot cable in a "quiet" en- 
vironment (square wave). 
If a comparison between oscillator stability in a "quiet" and an 
operating environment is made, an estimate of the noise contributed 
by the environment is possible. Comparison between the results for 
the oscillator and the generator yields an estimate of the instabilities 
contributed by the generator itself. 

Comparison of the stabilities of the generator outputs over short and 
long cables yields an estimate of the degradation due to the cable in 
the environment. Finally, comparison between the stability at the end 
of a long cable in both operating and "quiet" environments yields an 
estimate of the absolute contribution of the cable and another estimate 
of environmental noise. 

Almost all subsystems using outputs from this frequency generator 
are defined and operated in terms of real time. Therefore, short-term 
frequency stability is more appropriately defined and measured in 
the time domain. 



898 



THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1971 



6.2 Measurement Systems 

In Fig. 2, a measurement system similar to that of Cutler and 
Searle is shown. The optional multipliers are used for two reasons. 
First, it is often desirable to use similar oscillators. If the oscillators 
are truly of high precision, they are tunable only over a small range 
(one hertz or less) . One oscillator is tuned to nominal frequency. The 
other is offset by some predetermined amount. Using frequency multi- 
pliers, both oscillator outputs are multiplied up until the frequency 
difference between the two is 10 kHz. This permits measurement down 
to intervals of 100 microseconds. Secondly, in addition to the basic 
frequencies, all instabilities are multiplied as well. The use of multi- 
pliers enables the use of a counter that is less accurate than otherwise 
required. For example, assume that it is necessary to measure the 
stability of an oscillator to 1 pp 10 7 in one millisecond, using a beat 
frequency of 10 kHz. To be able to resolve this quantity, the counter 
must be accurate to one millihertz in a millisecond. If multipliers are 
used, however, the instabilities are increased by the multiplication 
factor. If the factor used is 100, the counter need resolve only 0.1 Hz. 
For higher multiplication factors, counter requirements are propor- 
tionately reduced. 

Up to this point, it has been assumed that the multipliers are 
perfect. Unfortunately, this is not the case. Highly accurate multipliers 
are extremely difficult to construct. Multipliers are susceptible to 
temperature variations and, if not properly designed, are sources of 
phase instability. When using multipliers, there is no guarantee that 
the measured instabilities are due to the oscillators. They may be 
due to instabilities within the multipliers. 

The problem of obtaining a large enough frequency offset is easily 
solved. Assuming two similar precision oscillators are present, it is 
possible to replace the quartz crystal in one oscillator with a similar 
type plated for either 10 kHz above or below 5 MHz. 
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Fig. 2 — Measurement system of L. S. Cutler and C. L. Searle. 10 
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The problem of obtaining the necessary resolution can be solved by 
using commercially available counters. There are at least two types 
available that have sufficient accuracy to enable precise measurement 
at short averaging times, without multipliers. The first, a Hewlett- 
Packard 5248L counter, has a 100-MHz clock, allowing measurements 
down to one millisecond with an offset of 1000 hertz. The second, a 
Hewlett-Packard 5360A Computing Counter, allows measurements 
down to 100 microseconds with an offset of 10 kHz. 

In an effort to verify the assumptions made in Section 4.2, the 
arrangement shown in Fig. 3 was used. The HP5248L was modified 
to have a one-millsecond recycle delay time. It was not possible to 
use the HP5360A in this configuration due to slower data transfer 
capabilities to the computer and interface incompatibility. A large 
number of samples were taken at various averaging times and the 
data recorded on magnetic tape. The quantities (<t v (N, T, t)) and 
(<r v {2, T, t)) were computed from the same data and compared. 

Using the configuration shown in Fig. 4, measurements were made 
with the HP5360A Computing Counter and associated keyboard. This 
unit can be programmed to calculate (<r y (2, T, t)> from its measured 
data. It is portable and was transported by automobile to test oscil- 
lators and frequency generators in use at various locations. 

5.3 Precision Oscillators 

The measurement systems used by the author are shown in Figs. 3 
and 4. Note that a 5-MHz square wave signal from the frequency 
generator was used as an external time base for the counter in Fig. 4. 
A slight improvement was noted due to the superior stability of the 
frequency generator over the internal time base of the counter. It was 
originally planned to use the 5-MHz oscillator being tested to drive 
the external time base. Unfortunately, the additional load degraded 
measurable stability. 

In the system shown in Fig 3, the oscillators, synthesizer, mixer, 
and video amplifier were located inside a shielded room. The counter, 
computer, and magnetic tape unit were located immediately outside. 
No frequency standard was available at the counter for use as an 
external time base. 

In Section 2.2., the assumption was made that instabilities in oscil- 
lators are independent random processes. It can be shown 9 that the 
variance of the sum of two independent or uncorrected random vari- 
ables is equal to the sum of the variances, provided that the variances 
exist. 
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Fig. 3 — Measurement system used for comparison of (<r v (N, T, r)) and <<r y (2, 
T, t)>. 

It was previously stated that it is often desirable to use similar 
oscillators. The process of selecting two oscillators at random from a 
large population of oscillators can be approximated by procuring two 
oscillators from a large supplier. Since the manufacturing processes 
are identical, it is assumed that the probability density and distribution 
functions of the oscillators are the same. The total measurable insta- 
bilities of the pair are then equal to twice the instabilities of either 
oscillator. Therefore, the variance measured is divided by two. Like- 
wise, the standard deviation can be divided by V2. In the case of the 
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Fig. 4 — Measurement system used by the author. 
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offset oscillator, it is assumed that modification of the crystal did not 
change the statistics by a significant amount. 

Using the arrangement shown in Fig. 3, a comparison between 
(<rl(N, T, t)) and (a 2 „(2, T, r)) can be made. These quantities represent 
the sum of the variance contributed by the oscillator plus the variance 
contributed by the synthesizer, since the processes are independent. 

When the arrangement shown in Fig. 4 is used, a very good estimate 
of the short-term stability in the time domain will result. 

5.4 Frequency Generators 

It was desirable to investigate the short-term stability of the 5-MHz 
square wave output of the frequency generator, described briefly in 
Section 5.1. The measurement system used was the same as that shown 
in Fig. 4 except that the 5-MHz square wave was substituted for the 
5-MHz oscillator. 

It seems logical that the stability of the generator would be worse 
than that of an oscillator, since the original sine wave produced by 
an oscillator has gone through shapers, counters, and other circuits 
used to generate the square wave signal. The exact magnitude of the 
generator instabilities can be easily determined. First, the total insta- 
bilities of the oscillator-generator combination are determined. The 
contribution of the oscillator, discussed in Section 5.3, may be sub- 
tracted out. The remainder is a good estimate of the variance of frac- 
tional frequency fluctuations from nominal frequency of the 5-MHz 
square wave. 

5.5 Synthesizers 

Short-term stability must often be measured when no auxiliary 
precision oscillators are available. By using a synthesizer, it is possible 
to obtain the necessary offset without the use of multipliers. Subse- 
quently, it is possibile to arrive at an estimate of the short-term 
stability, provided a sufficiently accurate counter is available (see 
Figs. 3 and 5). Several problems are introduced, however. In the 
preceding examples, the stability of each oscillator or frequency gen- 
erator could be determined. Such is not possible using a synthesizer 
since the contributions of the oscillator and synthesizer to equation 
(37) are unknown. 

If two similar synthesizers were present, these could be driven by an 
external precision oscillator and the stability determined as in the 
case of two similar oscillators. With only one synthesizer, an estimate 
of the stability of the oscillator-synthesizer combination can be deter- 
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Fig. 5 — Measurement system using a frequency synthesizer. 

mined. Then, it can be stated that the actual stability of the oscillator 
is at least as good as that measured for the combination. If the 
synthesizer was much better than the oscillator, the majority of the 
instabilities measured would be contributed by the oscillator. Un- 
fortunately, the reverse is usually true; the instabilities of the oscil- 
lator are small compared with those of the synthesizer. In some cases, 
however, the measured stability using such a configuration may be 
useful in evaluating system performance. 

VI. RESULTS 



6.1 Precision Oscillators 

In order to compare the actual relationship between (<rl(N, T, t)) 
and (<r*(2, T, t)), the arrangement shown in Fig. 3 was used. The two 
oscillators shown are similar except for the modified crystal in the 
4.99-MHz oscillator. It was assumed that the instabilities of the oscil- 
lators were similar. Therefore, the channel containing the synthesizer 
was inherently more noisy due to the mere presence of the synthesizer. 

In an attempt to minimize the measurable stability, a narrowband 
crystal filter was inserted between the synthesizer output and the 
mixer input. At averaging times shorter than the reciprocal of the 
bandwidth of the filter, significant improvement in measurable stability 
of the system was noted. At times longer than the reciprocal of the 
bandwidth, the presence of the filter caused a slight degradation of 
measurable stability. As a result, for these longer averaging times, 
the filter was removed from the synthesizer output. 

The total recycle delay time of the counter is about one millisecond. 
Therefore, T = t + 1 millisecond. For longer averaging times, this 
delay time is not significant. It was assumed for the longer intervals 
that T S r. 

The quantities observed are listed in Table I. Note the close corre- 
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spondence of (u v { N, T, T )> and (<r„(2, T, T )) for averaging times of one 
second and less. Since neither quantity is consistently larger than the 
other at all sampling times, it appears that correspondence would 
become even better if more samples were taken. 

At averaging times of ten or more seconds, (o- v (2, T, t)) becomes 
smaller than (v y (N, T, r)). It can be seen, in these longer intervals, 
that Bi{N, r, /*) is in the range predicted by Barnes 11 for flicker noise 
frequency modulation and superpositions of white and flicker noise 
frequency modulation. 

More precise measurements of (o-„(2, T, t)) over all time intervals 
were possible by using the configuration shown in Fig. 4. The improved 
precision was achieved by the elimination of the synthesizer and the 
use of a more accurate counter. The recycle delay time of the HP5360A 
is on the order of 1.5 milliseconds. As before, for the longer averaging 
times, it was assumed that T = t. 

First, measurements were made using several standard oscillators 
(averaging times from 0.1 millisecond to 10 seconds). Although the 
instabilities contributed by similar oscillators are theoretically the 
same, differences in stability were observed. Among the six standard 
oscillators tested, using the system shown in Fig. 4, one oscillator 
demonstrated generally better characteristics than the other five at 
the short averaging times. At longer time intervals, the measured 
stability of each oscillator was unique. For example, at a one second 
averaging time, the best oscillator demonstrated a stability of better 
than 6.3 pp 10 12 . [Here, the quantity measured was (<r„(2, T, t)).] 
The worst was about 1.4 pp 10 1X . The only differences in the oscillators 
were that oscillators one, two and three used solder-mounted crystals. 
The offset oscillator and oscillators four, five and six all used ther- 
mally bonded crystal units. It appears that the thermally bonded units 
exhibit more similarity between crystals. It is interesting to note, 
however, that the best stability at an averaging time of 10 seconds 
was observed using an oscillator containing a solder-mounted crystal 
unit. Likewise, the oscillator which demonstrated the worst stability 
also used a solder-mounted unit. Although the differences in the 
measurable stability of the oscillators using the thermally bonded 
crystal units were significant, these differences were still somewhat 
small. The stabilities measured are summarized in Table II and 
Fig. 6. 

In an attempt to determine the contribution of the environment to 
oscillator instabilities, all equipment in the system was de-energized. 
The only equipment which remained under power was the frequency 



SHORT-TERM FREQUENCY STABILITY 



905 



CO 

o 


© 

a 
ft 
m 


6 

a 
ft 

tN 


© 

a 
a 

© 

CO 


© 

ft 
ft 
© 

CO 


© 

i— 1 

ft 
ft 

CI 
CM 


© 

ft 
ft 

CM 

CN 


© 

ft 
ft 

CO 

as 

CO 


© 

i-H 

ft 
ft 

© 


© 

i-H 

ft 
ft 

CO 


co 


© 

a 
a 

i-h 

i-H 


© 

i-h 

a 
a 

1-H 
r-H 


© 

a 
a 

© 


© 

ft 
ft 

o 


O 

ft 
ft 

© 


o 

ft 
ft 

© 


© 

ft 
ft 

© 


© 

ft 
ft 
m 

CN 

© 


© 

ft 
ft 

CO 

© 


i-H 


© 

a 

a 

CO 

© 


© 

a 
a 

00 

to 


© 

a 
a 

© 


© 

ft 
ft 

© 


© 

ft 
ft 

© 


O 

ft 

ft 

oo 


© 

<-< 

ft 
ft 
© 

00 


© 

ft 

ft 

CN 

© 


© 

ft 
ft 

© 


a 

o 


o 

© 

i-H 

a 
ft 

CO 

to 


o 

6 

ft 
ft 

CO 

to 


O 

© 

a 
a 


© 

o 

i-H 

ft 
ft 
m 


o 

© 

i-H 

ft 
ft 

co 
© 


e 
© 

I-H 

ft 
ft 

CM 

© 


© 

1-H 

ft 
ft 

CO 


o 
© 

ft 
ft 

r-- 

*-< 

© 


o 

© 

i-H 

ft 
ft 

CO 
CO 

© 


! 


© 

I-l 

ft 

Oh 

T-< 

to 


© 

a 
ft 
q 
to 


© 

& 
a 

© 

© 


© 

ft 

ft 
© 
© 


© 

ft 
ft 
t- 


© 

ft 
ft 
t~ 


© 

1-H 

ft 
ft 

CN 


© 

ft 
ft 


o 

ft 
ft 

© 


o 


© 

p. 
ft 

CO 


© 

a. 
a 

CO 


© 

ft 
ft 

CO 


© 

ft 
ft 
co 


© 

ft 
ft 

CN 


© 

ft 
ft 
CN 


© 

i-H 

ft 
ft 

i-H 


© 

1-H 

ft 

ft 

CO 
(M 


© 

i-H 

ft 
ft 

iO 
(N 


1-H 

o 


© 

a 
ft 
co 

CO 


© 

a 
p. 

CO 
CO 


c 

ft 
ft 

(N 

co 


© 

ft 
ft 

CN 

co 


© 

ft 
ft 

■— I 

CO 


© 

ft 
ft 

i-H 

CO 


© 

ft 
ft 

© 

CN 


© 

ft 
ft 

© 

CO 


© 

1-H 

ft 
ft 

© 

CN 

CO 


c 
.2 
"3 

3 
bo 

tG 

c 
o 
O 


a 

O 0J 

S*P£ 

■§ow 
o 


6 to 

fc s 

03.2 > 

S 3 C 

o 


C 

O to 

a II 

d £•> 

— a. e 

o 


CM +5 

c 
o a> 

z e 

*.2'> 
S O'H 
O 


CO *j 

a 

O CU 

o-S 2 

JS «"> 

3 o. c 

"OH 
O 


CO +3 

a 

£ I 

M 

"3.2 > 

d 


C 

O CB 

°3£ 
* tS'> 

g ftc 

CO 

o 


ITS <j 

c 

O CU 
>7 bO P 

fe H" 3 O 

3*1 

<S cp > 

S ft e 

SOW 
co w " 

o 


© _ 

c 

O CO 

111 

oOW 

o 



906 



THE BELL SYSTEM TECHNICAL JOUHNAL, MARCH 1971 









































< 


k 








































N 




















































































































































/N. 












































































^> 












































































































































OSCILLATORS 1 






% 




































\ 


^ 






4&5 • 






























N 








^ 










^ 








in 12 


































3 





0.1 0.2 0.5 I 2 

ms ms 



5 10 20 50 100 0.2 0.5 I 2 

ms ms sec 

AVERAGING TIME 



5 10 20 50 100 

SEC SEC 



Fig. 6 — Short-term stability of six precision oscillators. 



generator, the offset oscillator, measurement equipment, and the air 
conditioning equipment required for forced air cooling of the frequency 
generator. Measurements were repeated for all time intervals. At the 
shorter intervals, no differences were apparent. In some instances, 
stability was slightly improved at intervals of 100 milliseconds or 
longer but only by an amount of questionable significance. 

Since these results were not as anticipated, the causes for the 
disparity were investigated. The only obvious reason was inherent 
in the design of the mixer circuit. The mixer contains four small ferrite 
cores. About twenty feet from the frequency generator is a large power 
transformer which is used in the power distribution network for the 
entire data processing laboratory. Even with the remainder of the 
data processing system idle, this transformer must be energized, as it 
supplies power to the generator. Ferrites have been found to adversely 
affect short-term stability when used in the presence of electro- 
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magnetic fields. 17 The effect of the field created by the power trans- 
former on mixer performance is unknown. 

Other than the ferrites, no reason for the discrepancy was apparent. 
The most logical reason, however, would be that the measurable sta- 
bility is limited by the noise characteristics of the measurement system 
itself. If the noise characteristics of the system were much worse than 
that of the oscillators, no differences in measurable stability would 
occur. Since differences between oscillators can be observed, the oscil- 
lators must contribute a measurable amount of the noise. As a result, 
if the noise characteristics of the measurement system were improved, 
measurable stability may improve, but probably by less than an 
order of magnitude. 

6.2 Frequency Generators 

6.2.1 General 

Each frequency generator contains three precision oscillators. Any 
of the three oscillators may assume any of the three functions. The 
functions are switched by means of control panel and associated relays. 
The normally closed positions of the relays constitute the usual ar- 
rangement and is referred to as the "normal" mode. These are 

Oscillator #1 = MASTER, 
Oscillator #2 = SLAVE, and 
Oscillator #3 = STANDBY. 

The outputs from the phase-locked master-slave pair are digitally 
mixed and sent through counter chains and frequency multipliers to 
arrive at the various output frequencies. As mentioned above, it fol- 
lows that the stability of the generator should, in general, follow the 
stability of the oscillators used as the frequency sources. 

The observed stability of the six oscillators differed for time inter- 
vals of one second or longer (see Section 6.1). Ironically, the oscillator 
installed in the number one position in frequency generator #1 
demonstrated the worst stability at the longer intervals. Oscillator 
number three demonstrated the best. 

The oscillator functions were redesignated 

Oscillator #3 = MASTER, 
Oscillator #2 = SLAVE, and 
Oscillator #1 = STANDBY. 

As anticipated, the observed stability improved. Most measurements 
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were taken using the "normal" mode, as this is the usual configuration 
employed during operation of the data processing system. 

6.2.2 5-MHz Square Wave, Ten-Foot Cable 

On frequency generator #1, measurements were taken in both 
operating and idle environments. As was the case of precision oscil- 
lators, little difference was apparent. On frequency generator #2, 
measurements were taken in an operating environment only. 

To make estimates of the short-term stability of the generator, it 
was necessary to obtain the variance of the fractional frequency 
fluctuations of the offset oscillator-frequency generator pair. When 
these were determined, the variance contributed by the offset oscil- 
lator was subtracted out of the data. 

The question at this point was, which oscillator-data should be 
subtracted out to arrive at a reasonable estimate of the square wave 
stability? The data from the best oscillator pair from each frequency 
generator was used. If the data from the worst pair was used, the sta- 
bility of the generator may be too optimistic. Since the offset oscillator 
used a thermally bonded crystal unit, the actual stability is probably 
similar to the other oscillators using thermally bonded units. 

In extremely critical applications, the measured stability between 
the oscillator-generator pair can be considered to be the stability of 
the generator itself. It may be safely assumed that the actual stability 
of the generator is no worse than the measured stability of the 
oscillator-generator pair. 

See Table III for a listing of the quantities observed. Figure 7 
shows the same data in graphical form. 

6.2.3 6-MHz Square Wave, 200-Foot Cable 

On frequency generator #2, measurements were made only in an 
operating environment. Measurements were taken on frequency gen- 
erator #1 in both operating and idle environments. Little, if any, 
difference was noted between the two environments except as noted 
below. 

At intervals of 100 and 400 microseconds, little difference between 
the short and long cables was apparent. At averaging times of 1 milli- 
second, the measured instabilities began to increase. At 10 milli- 
seconds, the additional instabilities reached a peak about forty percent 
above the short cable. For 100 milliseconds, the figure had declined, 
although not to the level present using the short cable. At intervals 



SHORT-TERM FREQUENCY STABILITY 



909 



o 

< 

fa 
V. 

w 
C 

{* 

o 
z 

a 
fa 

a 

^- 
C 
|S 

H 

fa 
o 



pq 

<i 

a 

fa 
H 


3! 
00 



fa 






















H 


H 


- 


'< 









O 


O 














r-H 


.— I 










0. 










ft 




0. 


a 


a 


a 


a 


a 


■r. 




a 


a 


a 


a 




O 


3 


© 


■* 


CO 


t^ 


CO 




<N 


oi 


cn 


<N 


t^ 


CO 































O 








O 


>— 1 





cc 


1— 1 


»-H 


H 


i— t 


a 
a. 


1— 1 


a 


ft 


a 


O, 


ft 




a 


a 


ft 


ft 


>o 


ft 




(M 


C-l 


CN 


.— i 


co 


fffl 




oi 


oi 


<N 


c^i 


1—1 


CN 







































O 








O 




6 





^H 


c 


^H 


r— * 


w 




—< 


a. 


.-< 


a 


a 


P 


a 


a 


a 


a 


ft 


a 


O 


a 


a 


1—1 


0. 


co 


m 


O 


"* 


co 


lO 


"*. 


CO 


to 


1— 1 


•-< 


"^ 


1-1 


1—1 


1—1 


'~ l 


















Ol 


a 








© 


£> 







O 


•— 1 


*— H 


»-H 


•— « 




-* 


•^ 


a 


a 


a 


a 


d 


ft 


a. 
a. 


a 


a 


a 


ft 




0. 


,_, 


,_i 


CO 


■* 


O 


■* 


PS 


O) 


CO 


^ 


00 




1-1 


1—1 


'"" , 


" 


~ 


" 

















00 














f* 


i-H 


»— 1 




"* 


1-1 


a 


a 


a 


ft 


6 


a 


a 


p. 


a 


a 


ft 


a 


0. 


CO 


CN 


T)< 


>o 


■H 


■-• 


■— 1 




■-; 


CN 


N 




1—1 


r ~* 


^^ 


1—1 


'~~ t 


" 




& 












O 


05 
g 







PH 


O 


^^ 


— 


a. 


~~ 


a 


,H 


a 


a 


a. 


0. 


a 


a 


a 


•* 


a 


CD 


a 


10 


a 


1^ 


O 


co 


N 


co 


CN 


CO 


IQ 




(N 


ci 


(N 


<N 


N 


c-i 




O 





O 


O 


O 





S 






1— 1 


rH 


wi 


*- h 


P 


a. 


a 


a 


a 


a 


a 


T-i 


a 


0. 


a 


a 


ft 


a 


© 


CD 


CO 


m 


10 





CO 




10 


>C 


>ra 


>o 


r-^ 


CO 




rH JW 


^H,4> 


^-_4> 


rH « 


»*£ 


CN^J 


O 


• 3 


--Q 


^-° 


^-° 


r!-9 


o-S 




ri 


O c3 


O oj 


O a3 


a 


O o3 


ts 


ZO tc 


zu 


fafi 


ZO 


ZO U 


ZO 


s 

b£ 


t- -«-. .— 


Urn ♦- 


o^.S 


lH -i-3 


— — .— 


it c 


O O^ 


O O 


O O 


ti 


0.1= 


♦5 a as 

St. | 


■*-* O -^ 


*-> — 


•«-> Q 


*- O « 


«o^ 


c 


Sfc.s 


a: rv, cs 

hi ^T 1 -- 


Genera 
200-F* 
Quiet 


£lf g 


2fa 2 







12^ 
O 


g2o> 



Gene 
200- 
Ope 


£2o 
O 


Gene 
200- 
Ope 



910 



THE BELL SYSTEM TECHNICAL JOURNAL, MARCH 1971 



5 

2 
10 8 

b 


S 




































\ 


* 






































\ 


L 






































































































^ 










































































10 10 










































































































































GENERATOR 1 




10" 
























N 


\, 






















































2 










































10< 2 







































0.1 0.2 0.5 I 2 

ms ms 



5 10 20 50 100 0.2 0.5 1 2 

ms ms sec 

AVERAGING TIME 



5 10 20 50 100 
SEC SEC 



Fig. 7 — Stability of two frequency generators, ten-foot cable. 



of one and ten seconds, instabilities returned to the level observed 
using the short cable. 

Some of the causes of the additional instabilities centered at ten 
milliseconds are identifiable in this instance. In many data processing 
systems, pulse rates of 100 bits per second are used. Since this rate has 
a duty cycle of ten milliseconds, it is not surprising that averaging 
times of ten milliseconds would be affected. Comparing the data be- 
tween quiet and operating environments, it became apparent that 
averaging times of ten milliseconds were indeed affected by the opera- 
tion of the data processing system. In addition, the period of the second 
harmonic of the power line frequency occurs near this rate. Much 
longer time intervals are not affected by either of these noise sources. 

The stabilities observed for both frequency generators are plotted in 
Fig. 8. The same data is presented in tabular form in Table III. 
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6.3 Synthesizers 

A Hewlett-Packard model 5105A Frequency Synthesizer/51 10B 
Synthesizer Driver was arranged as shown in Fig. 5. A model 5100A 
Frequency Synthesizer/5 11 OB Synthesizer Driver was used in Fig. 3. 
A 5-MHz precision oscillator was used as an external frequency stand- 
ard input to the driver in both applications. In the neighborhood of 5 
MHz, the short-term stability of the 5100A is much better at all time 
intervals than that of the 5105A. As a result, the 5100A was more use- 
ful in evaluating performance of oscillators and frequency generators. 
The 5105A has a higher frequency capability than the 5100A, and 
produces the best short-term stability at these frequencies. 

Using the 5105A, the synthesizer output frequency was adjusted for 
4.99 MHz. The output was mixed with the 5-MHz oscillator which 
was being used as the external reference. Here, the stability of the pair 
was about 2 pp 10 10 over one second. A 5-MHz square wave was then 
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Fig. 8 — Stability of two frequency generators, 200-foot cable. 
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Fig. 9 — Performance of frequency synthesizer, one-second averaging time. 



mixed with the synthesizer output with no significant change in results. 

The frequency of the synthesizer was then readjusted for 990 kHz 
and the output was mixed with a 1-MHz square wave signal from 
the generator. The stability was now reduced to 1.5 pp 10° over one 
second. 

The frequency was then increased to 19.99 MHz and the output was 
mixed with a 20-MHz square wave signal from the generator. In this 
configuration, measurable stability improved to 5 pp 10 11 over one 
second. 

Figure 9 shows a plot of the frequency versus the standard deviation 
of fractional frequency fluctuations for a one-second averaging time. 
The specifications from the manufacturer's catalog are plotted on the 
same graph. Since the slopes appear the same, the synthesizer is the 
most likely source of the majority of noise. It may be assumed that 
the stability of all the frequencies measured are of the same order as 
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the stability observed for the 20-MHz square wave. In reality, all may 
be somewhat better. Similar data for the 5100A Synthesizer was not 
taken. 

6.4 Systematic Effects 

From the experimental data, it seems that systematics from the data 
processing system do not contribute as large a portion of the instabili- 
ties as previously suspected. It must be noted, however, that the data 
processing environments used for testing purposes were only small, 
developmental varieties of the larger system (to be constructed at a 
later date) . It is anticipated that the larger system will contribute more 
systematic noise to all frequency sources within the system. 

Several discussions took place with individuals involved in short- 
and long-term stability measurements. Some of these individuals had 
made such measurements in areas where machine tools or other heavy 
electrical equipment were operated. There seemed to be a general 
consensus that stability is degraded at 8:00 a.m. and 4:30 p.m. or 
whenever the equipment is being started or stopped. Since no heavy 
machinery was located in the near vicinity of the data processing 
systems, these effects were not observed. 

Each day, somewhere between 4:00 and 4:15 p.m., it was noted that 
observable stability became two to three times worse than that norm- 
ally observed. About 4:30 p.m., the instabilities returned to their 
former level. Occasionally, the same effects were observed at other 
times during system operation. 

Investigation yielded two causes for these observations. First, many 
individuals are dumping data on the various input-output devices to 
prepare for the change in shifts. Second, a concept of "rotation" is 
present to make the system available to individuals wishing to run 
software tests. Time intervals of five minutes are scheduled in advance. 
Individuals are generally prepared with magnetic and paper tapes and 
subject the system to heavy use during their five-minute allotment. 
It appeared that the increased instabilities observed during mid-day 
operation occurred during rotation periods. 

Accuracy of measurements was probably reduced due to systematic 
noise introduced by the measurement system itself. For a good charac- 
terization of the noise due strictly to the oscillator or frequency gen- 
erator plus induced noise from the environment, the system should 
have a noise level capability of at least two orders of magnitude better 
than the anticipated stability of the unit being tested. 
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VII. RECOMMENDATIONS AND CONCLUSIONS 

The aspects of short-term frequency stability applicable to most 
situations have been discussed. Although definitions were made in both 
the frequency and time domains, the time domain definitions were used 
for measurement. 

With the vast increase in the use of precision oscillators, measure- 
ment techniques must be fast, accurate, and easy to perform. Fre- 
quency domain measurements are extremely difficult to make accu- 
rately. In addition, such measurements take a long time to gather 
sufficient data. 

The actual observable relationship between (<t v {N, T, t)) and 
(<r, / (2, T, t)) was discussed. It was shown that the two quantities are 
very nearly equal for averaging times of one second or less. For longer 
times, the results are in agreement with those predicted by Barnes. 11 

Time domain measurements, using a device such as the HP5360A 
computing counter, are fast and consistent. The accuracy limitations 
of such measurements depend mainly on mixing and filtering equip- 
ment. A good method for determination of the short-term stability of 
precision oscillators and frequency generators is the use of an offset 
oscillator to obtain a frequency difference. 

Further investigation of systematic effects is in order. Initially, sys- 
tematic noise due to the measurement system must be minimized. 
Then, estimates of the stability of the oscillators in a quiet environ- 
ment should be performed. Next, estimates should be made in an 
operating environment under controlled activity levels. Using this data, 
it may be possible to generate a mathematical model of the contribu- 
tions of the systematic effects of the data processing system to the 
short-term frequency stability. 

Investigation of the distribution of the instabilities would be ex- 
tremely useful in evaluating performance of the measurement system. 
Such computations can be made by appropriate programming of the 
HP2116B computer shown in Fig. 3. 
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